Shape-From-Silhouette of Articulated Objects and its Use for Human Body Kinematics Estimation and Motion Capture
نویسندگان
چکیده
Shape-From-Silhouette (SFS), also known as Visual Hull (VH) construction, is a popular 3D reconstruction method which estimates the shape of an object from multiple silhouette images. The original SFS formulation assumes that all of the silhouette images are captured either at the same time or while the object is static. This assumption is violated when the object moves or changes shape. Hence the use of SFS with moving objects has been restricted to treating each time instant sequentially and independently. Recently we have successfully extended the traditional SFS formulation to refine the shape of a rigidly moving object over time. Here we further extend SFS to apply to dynamic articulated objects. Given silhouettes of a moving articulated object, the process of recovering the shape and motion requires two steps: (1) correctly segmenting (points on the boundary of) the silhouettes to each articulated part of the object, (2) estimating the motion of each individual part using the segmented silhouette. In this paper, we propose an iterative algorithm to solve this simultaneous assignment and alignment problem. Once we have estimated the shape and motion of each part of the object, the articulation points between each pair of rigid parts are obtained by solving a simple motion constraint between the connected parts. To validate our algorithm, we first apply it to segment the different body parts and estimate the joint positions of a person. The acquired kinematic (shape and joint) information is then used to track the motion of the person in new video sequences.
منابع مشابه
Articulated Soft Objects for Multiview Shape and Motion Capture
We develop a framework for 3–D shape and motion recovery of articulated deformable objects. We propose a formalism that incorporates the use of implicit surfaces into earlier robotics approaches that were designed to handle articulated structures. We demonstrate its effectiveness for human body modeling from synchronized video sequences. Our method is both robust and generic. It could easily be...
متن کاملEstimation of the Accuracy of a Shape-from-silhouette Markerless Motion Capture System
INTRODUCTION The most common methods for accurate capture of three-dimensional human motion require a laboratory environment and the attachment of markers or fixtures to the body segments. These laboratory conditions can cause adaptive changes to normal patterns of locomotion that introduce experimental artifact. For example, it has been shown that attaching straps to the thigh or shank alters ...
متن کامل3D Body Reconstruction for Immersive Interaction
In this paper we present an approach for capturing 3D body motion and inferring human body posture from detected silhouettes. We show that the integration of two or more silhouettes allows us to perform a 3D body reconstruction while each silhouette can be used for identifying human body postures. The 3D reconstruction is based on the representation of body parts using Generalized Cylinders pro...
متن کامل3-d Hand Pose Estimation and Shape Model Refinement from a Monocular Image Sequence
This paper proposes a method to precisely estimate the shape and pose of articulated objects like a human hand. First, rough estimation is obtained using silhouette matching. Next, we apply the extended Kalman lter to tting a model to an image. However, because monocular images contain no depth information, ambiguity of the shape and pose cannot essentially be resolved for articulated objects. ...
متن کاملImproving real-time human pose estimation from multi-view video
Capturing human motion is a key problem in computer vision, because of the wide range of applications that can benefit from the acquired data. Motion capture is used to identify people by their gait, for interacting with computers using gestures, for improving the performance of athletes, for diagnosis of orthopaedic patients, and for creating virtual characters with more natural looking motion...
متن کامل